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ABSTRACT 



A compact coDvenicnt hand-held, accelerometer-based com- 
puter control device is utilized to control on-screen animated 
characters presented by a oon^uter-driven display in which 
the movement persona, or style of the character is con- 
trolled through movement of the device in a predetermined 
pattern which results in recognizable patterns of accelera- 
tions that arc detected to give the on-screen character a 
particular persona or style detennined by the user. Thus, the 
system requires only a series of easily learned hand move- 
ment patterns for corresponding character caitroL In an 
alternative embodiment, once a movement has been 
determined, the style or emotional content of the movement 
is specified directly from gross accelerometcr output without 
pattern matching. Id another embodiment, the ou^uts of two 
or more accelerometers are combined, with the combined 
waveforms constimting a language for grq>hical object 
control. In a still furdier embodiment, one or more patterns 
are detected serially as a language to direct ^e appropriate 
movement or persona for the character or icon presented 
on-saeen. In yet another embodiment accelerations ate 
normalized to the local gravitational field such that the 
orientation of the control device is irrelevant In an addi- 
tional embodiment since the location of the on-screen 
character is known, the character may be given incremental 
motions from this location by moving the device in the 
direction of the intended incremental motion, thus to dlirect 
the motion of the character in the same direction as the hand 
movenkent 

11 Claims, 12 Draiiring Sheets 
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HAND HELD COMPUTER CONTROL **'^*'^f ' fth^ ^1^^^ 

DEVICE mentioned patent, the movement of the individual characters 

liiLvivE. representing a particular person can be controlled through 

data gloves, data suits, chair input devices and the like. 
FIELD OF THE INVENTION j These devices arc in some sense cumbersome, and it is 

T.^ invention relates to cornputcr ^n^^ S^dlS^S^^^^^ 

particularly to a hand-held device for confroUing movement ^f^^^vS^^^^^ also the mood or the persona 

and persona of an on-screen graphical objert. icon or individual wishes to impart to his on-screen 

character without providing fricuonal contact or mechanical ch^g^^ 

coupling of the device with a fixed surface or structural lo ^ j^^^^ncd above, in this patent cartoon characters are 

clement prestored to dramatically reduce the bandwidth required for 

BACKGROUND OF THE INVENTION teleconferencing. During the teleconferencing scenario, the 

As described in U.S. Pat. No. 5347306. issued to Tohci individuals participating in a conference need to be able to 

Nitta on Sep. 13. 1994. and incorporated herein by ^5 control how they are presented to the conferees. This is 

reference, an electronic meeting place can be provided in accampUshed through the Provision of the a^ociat«l pex- 

S conferees or partidpanU Ln meet thrt^u^control of sona commands, in one embodonent Fovidmg physica^ 

r^en characteTrTovcments of which are under switchesateachof the terminals for ead, of the partiapants 

control of the individuals. The system described in this in a distributed teleconferencing network, 

patent utilizes cartoon characters or icons in wdcr to avoid However, the utilization of individual switdics, or even a 

the problems with fuU-frame video teleconferencing. mouse driving a cursor on a screen menu is a cumbcrwime 

However, in the portrayal of one's self in tenns of an way in which to control what other conferees see of the 

on-saeen character, it is necessary to provide this characia individual conferee. There is therefore a requirement for a 

witti a persona, style, or mood specified by the individual hand-held device which can be free of contact with a table 

participant As described in this patent, Ae pereona is ^5 or other flat surface that can be conveniently waved around 

controUed by switches on a keyboard or in a separate box so by an individual confa-ee to permit control of his diaractcr 

that full control can be provided over die representation of without the requirement of wearing a data suit or a d^ 

the individual partidpanL glove, without the requirement erf detecting hand or body 

B will be appreciated that the utilization of separate position through optical recognition techniques which me 

switchesandkeyVttokesisacuinbersomewaytocontrDlthe 30 computer intense and slow, and without any physical attach 

persona of the on-screen character. While it might be pos- ment to a fixed structure to sense hand or finger position. 

siHe to use the traditional cwiqjutcr mouse to in some way Again, by way of background, hand gestures have been 

control character persona or style, such a system is not easy utilized hi conmuinication systems for ttic deaf. U.S. Fat 

to use and requires tiie individual to be at ttie con^juter No. 5.047.952 describes an instrumented glove to produce 
tctminaL It would not be possible when using the computer 35 signals corresponding to hand configuration utilizing strain 

mouse to sit back in one's chair or move around during sensors. A system for converting an unage to an animated 

teleconferencing. There is therefore a need for a more cartoon-like drawing through a so-called contour extractor is 

practical and simpler way to control the on-screen diarac- illustrated in U.S. Pat No. 4.546383. U.S. Pat No. 4,884, 

^ 972 utilizes a mouse to select words fw animatpd characters. 

More particulariy, as is weU known, a mouse is utilized to 40 whereas U.S. Pat No. 4,906,940 toalbes a system for 
control cuKors rewcsented on a computer screen in which extracting features and ^^^^^ for inacAine control. 
Z^^^soriscon^\i7throaf^thcMc^o^ Moreover, U.S. Pat Na 5,008.946 describes a system 
conSrtof the mouse's roller balls with a fixed surface, sensing the movement of one s ^^^^^^J"^!"'^^^ 
usually in the form of a so-caUed mouse pad. WhUe the control a car. whereas U.S. Pat. 4.414.537 sh9ws a man- 
utilization of a mouse for counter control is indeed an 45 machine interface utdmng a data glove, U.S. Pat Na 
efiident method for control of computer operations, the 4,567,610 iUusfratcs a reference histog^ 
mouse has not been utilized to contiT^ persona or style recognition, whereas the foUowmg articles and thesis 
of icons or on-screen characters but rather has been used to describe hand gesture recognition systems and adaptive 
move on-screen objects by cUcking on them and dragging interfaces relating to hand gestures: 
them to different locations, with the Icngdi of the move 30 Tomoichi TWcahashi and Fumlo Kishino, Hand Gesture 
proportional to the movement of the mouse over the mouse Coding Based on Experiments Using a Hand Gesture Intcr- 
MdTThc traditional mouse is thocforc incapable of con- face Device, SIGCHI Bulletin, April 1991; Interpreting Sign 
trolling tiie persona of a cartoon or other character which is Language. IEEE Convutcr Graphics & Applications, Janu- 
prwcmed on-scieen in a conferencing or meeting scenario to ary 1994, pps, 36-37; Jennifer A. Hall.The Human ^tcrface 
represent the individual communicating with others in an S5 in Three-Dimensional Con^)uter Art Space. Media Lab, 
electronic meeting place or other environment Massachusetts Institute of Tedmology, MSVS Thesis, Oct 

Specifically, in order to get a graphical object on a screen 18. 1985; and, S. SidneyPds ^^^^^^Z^'''^ 

to n^^^ven directi^ wi^V^se, one must click with Neural Network: The Glove-Mk Pilcj Study DcT««rt^ 

on the object and then move the mouse to drag it l>y ment of Computer Science. Univers tyof Toronto, Tech 

specifying each location along the desired path. Thus a eo Repwt No, CRG-TR.9a.l, February 1990. 

™hical objea cannot be made to move in a desired It wiU be seen that while there are various ractiiods of 

direction widiout specifying eadi point along the way. As a hand gesture recognition, they rely on multiple hand ges- 

resuU. siiiqilc movements of tfie gr^hical object cannot be turcs for computer control As such, signing recogmtion is 

made by merely directing the graphical object to go in a much loo conq)Ucated for machine control as tiie difference 

desired direction. Thus tiie mouse is inefiBcient botii to 65 in the various hand signs are difficult to recognize, and tiie 

specify simple movements and to give a grajAtical object a language associated witii hand signing too complex for 

desired persona. machine control. 
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Note that in tcnns of arcade games, joy sticks, and the like 
coDtiol fftphicsi objects through the use of strain gages and 
switches, with the strain being measured between a fixed 
structure and the joy stick. These are siinplc systems which 
do not analyze strain gage wavefomis not combine wave- 5 
fonns for graphical object controL Thus there ore no com- 
parisons or cocrelations witti templates that can be used to 
establish the existence of a given gesture or series of 
gestures. As a result television game control devices gener- 
ally do not provide a sufficient level of sophisticatioD to lo 
control the persona of graphical objects rqvesenting human 
beings. 

SUMMARY OF THE INVENTION 

What is provided in one embodiment for the control oi 
gr^hical objects is a hand-held device which is moved or 
waved around by the individual In a series of easily learned 
patterns, with each pattern or series of patterns resulting in 
the desired control of the on-saeen character. In one 
embodiment an egg-shaped device is provided with internal ^ 
orthogonally-oriented accelerometers. with the sensed 
accelerations being converted via an analog-to-dlgital con- 
verter to signals which are transmitted to the conq)Uter. The 
accelerations provided by different hand gestures or move- 
ments are identifiable through the utilization of teixq>lates ^ 
wfaicb provide histograms of the patterns to be recognized. 
Ccrrdation of raw data to the templates provides for the 
generation of control signals for generating the control of the 
expropriate on-screen graphical object In such embodi- 
ments the system includes a training session in which an ^ 
individual trains the system for the particular patterns he 
desires for the ooDtn^ of the graphical object in questioa 
After the training session, the accelerations are utilized to 
control the on-screen graphical object so as to either move 
the gr^>hical object or provide it with actions depicting a 
particular persona or mood which the individual wishes to 
inq>art to his character. 

In one embodiment, a character can be made to execute a 
sin[9)le motion to track the modon of the contrc^ device. 
Since the character is already located at a point on the ^ 
screen, incremental on-scxcen movements in a given direc- 
tion can be instigated dirou^ movement of the hand-lield 
device in the desired direction, assuming the hand move- 
nt! is recognized for the particular grqdiical object move- 
ment 

In another embodiment once a particular noovcment is 
selected for an on-screen icon or character, raw aocelerom- 
eter outputs are used directly to control the intensity/style of 
dils oD-screen icon. ^ 

Because in one embodiment the hand-held device is in the 
form of an egg, the egg-shaped device has a natural orien- 
tatton when grasped by the hand. This gives the user the 
perception or tactile feedback as to how to move the device 
to achieve, for instance; the desired direction of movement 
As contrasted to a hall-shq)ed device or any device with 
point symmetry, die use of the egg gives the device a 
perceived up orientation to make it natural to specify other 
directions with hand movenoents. 

In a preferred embodiment, the accelerations are normal- 60 
ized to die local gravitational field vector both to provide a 
stationaiy reference for the analysis oi the accelerations 
regardless of the orientation of the device within the hand, 
and also to resolve any aUasing or 180 degree ambiguity, 
making device orientation irrelevant ^ 

In a further embodiment and to eliminate false activation 
of the graphical object control system, a button is placed on 



360 

4 

the device, in the egg embodiment at the top of the egg, 
whid) is actuataUe by the thumb in order to start the 
acceleration detection process. Frior to thumb activation, all 
accelerations are ignored, whereas during the depression of 
the thumb switch, acceleration data is transmitted for decod- 
ing and graphical object control. 

It will be appreciated that what is provided is a hand-hdd 
device which operates in free-air in an untcthered state and 
requires no physical contact with a fixed structure for die 
provision <^ computer cotar<A information. As such the 
subject hand-held device is said to be non-contactual. 
Rather, the device fits easily within the hand, and in one 
embodiment is not umbilicaUy tied to the computer, but 
rather conmuinicates with the computer contrc4 system via 
wireless data transmission. 

The convenience of such an ergonometrically designed 
computer control device makes it easy for the participants in 
an electronic meeting place type conference to control dieir 
associated characters. During a conference, for instance, an 
individual depicted by his/her character to be seated at a 
table may be made to rise from his/her seat and pace off. as 
if in anger; or may be made to appear either bored or 
agitated, con^ktely at the discretion of the individual 
controlling the representation of himself^erself . Thus the 
movement of die character and the persona of the character 
can be easily controlled with a pleasing hand-held device in 
which the orientation of the device within one's hand is not 
critical to the ability to effectuate characta control or 
grs^cal object control timmgh a limited series of highly- 
defined hand gestures or nx)vements. 

As part of the subject invention, a scries of gestures may 
be considered to be a language such that when the gestures 
are pexfocmed in a predetermined sequence;, the correlation 
is made to a particular type of oonq)uter controL Thus while 
the system will be described in accordance with the control 
of graphical objects, con^uter control through a language of 
a scries of sensed motions is within the scope of this 
invention. 

In summary, an unconstrained, hand-held conQ)uter con- 
trol device, in one embodiment accebrometer-based. is 
utilized to oontrol gr^hical objects in a conqiutcr-driven 
display in which the movement and persona of the grs^hical 
object is controlled through movement and resulting accel- 
erations of the hand-held device, such that con^uter control 
is effectuated without the requirement of a roUer ball con- 
tacting a fixed surface to int>vide positional ii^t In cme 
embodiment a series of easily learned hand movements <x 
gestures provide foa- the cotresponding grs^ihical object 
control in which one or more hand gestures or movements 
are de t ec t ed serially as a language to otoin die appropriate 
movement or persona of the graphical object presented 
on-screen. In order to noake device movement recognition 
Independent of device orientation, in a preferred mtx>di- 
ment accelerations in the X and Y directions are referenced 
to the local gravity vector, making it unnecessary to ascer- 
tain the orientation of the hand-manipulated device in order 
to provide highly recognizable hand movement and gesture 
recognition. In one enibodiment. the device is egg-shaped to 
]Hx>vide a preferential orientation of the device in the indi- 
vidual's hand, thereby to be able to specify a general up 
direction for the device. In anoAer embodiment a Z direc- 
tion accdcrometer Inaeases die number of hand movements 
or gestures that can be recognized, with a button or switch 
at the tc^ of the egg. in a finthcr embodiment providing an 
actuation signal for the start of the detection process, thus to 
eliminate false activations. In a preferred embodiment die 
control device is wireless for ease of use. whereas in anothcr 
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cmbodim€iil.the control device includes accelcrometers and of character 16. a hand-held device 20 gener^y in the f^ 

a processor mounted at the top of a wand, with electrical of an egg is grasped by a hand 21 so that the egg, when 

comiections at the base of the wand being hard wired to the picked up from its holder 22 can be made to move gcneraHy 

computer. Also, as part of the subject invention, any in the directions indicated by A, B, C. D, E, and F thereby 

co^ter-drKen gr^hical object may be controlled such 5 to effectuate control of character 16, in one cmbodmicnt. m 

diat the hand-held device provides the requisite gcneraUzcd corresponding directions. 

computer control, with visual feedback being provided by ft will be appreciated that while the subject invention will 

the display. be described in terms of the aforementioned movements, the 

movements of device 20 may be made to control different 

BRIEF DESCRIFnON OF THE DRAWINGS lo motions or personas of the graphical object However for 

™ ^ r ^ **u T-,^«h«« easeof discussion, it will be appreciated that in the cmbodi- 

These and other featurc^f the ^^^f^^^^^'L^ ^ent shown, device 20 when Lved from its original rest 

better ""^crstood m connection wt^^^^^ origb 24 in the direction of dotted arrow A results in 

tion taken in conjunction with the Drawings of which. 3^^,^^ character 16 in the direction of dotted anow A 

FIG. 1 is a diagrammatic iUustiation of the subject egg- ^^^^ grasping device 20 and moving it 

^aped computer control device illustrating movement ^tfie ^ position towards the right, character 16 moves 

device and coffesponding motion and persona control of the towards the right at a predetermined speed and fw a prcde- 

individual's on-scrcen characta; tcrmined length of time. 

FIG. 2 U a block diagram of the subject system illustratmg Likewise when device 20 is moved to the left as indicated 

the detection of device accelerations, the conversion of me 20 3 then character 16 is made to move 

analog accelerations to a digital format, tiie transmission <rf backward as illustrated by dotted anow B on screen 14. 

the accderation Moniuition to arcjxiv^^ ^ 

of the infomiation to provide graphical ob^ec^ control; J^^^^'Zan upward direction as illustrated at C then 

FIG. 3 is a scries of vector diagrams illustratmg mc j^jr^cter 16 can be made to move away from the plane of 

motions that provide graphical object control forlhegraphi- 25 ^j^^ g^j^^^i^ereas fo, ^ niovement of device 20 from a rest 

cal object <rf FIG. 1; position in a downward direction as illustrated by dotted 

FIGS. 4Aand 4B illustrate a language comprising a series ^jj^^ jy diaractcr may be made to move towards the 

of device movements which either individually or serially screen. 

provide for graphical object controL In which in one ^ count, if the device is made to move in a circular 

embodiment the language includes a movement to specify illustrated by dotted arrow E, the character, in one 

direction, foUowed by a movement to specify an action and embodiment, may be made to do a flip as iUustrated by 

foUowed by a movement to specify an intensity, all for tfie ^^^^ g ^^^^^ 

control of the graphical object while the above relates to motions of the character, it is 

FIG.Sisablockdiagramof the subject system lUustratmg ^^^i^ for instance to provide the character widi an agi- 

preprocessing functions; 1^ ^ moving the device back and forth in the 

FIG. 6 is a more general blodt diagram of the subject direction of dotted arrow F in a shaking motion whidi, inter 

system. alia, could make the character 16' s hand to move back and 

FIG. 7 is a series of diagrams describing the motion of the f^th as illustrated by double-ended arrow F on screen 14. 
computer control device to achieve the indicated on-saccn 40 What will be appreciated is that movement of device 20 

action of a predetennined character or icon; jj^ ^ results in a predetermined motion or characteristic 

FIG. 8A-W are combined acceleration waveforms of the COTresponding on-screen character or graphical object, 

derived from the raw accelerations from orthogonally on- with there being no tethering of the device to the coiiputcx- 

ented acccleromcters witWn the confer control device of driven display, and without contact of the device with a fixed 
FIG. 1, with the waveforms corresponding to various 45 structure or object such as a mousepad. 

motions of the con^uter control device to effectuate the ^ ^ described in connection with FIG. 2. device 20 

indicated on-screen character control; be provided with accelerometers to sense the motion of 

FIG. 9 is a graph of intensity of action versus valence for device 20, with the ou^ts of the accelerometers being 

specifying an entire range of human emotion to arrive at a analyzed to determine tiic accelerations of the device. In 
set of parameters to control the emotive content of an ^ order to eliminate false actuatiom device 20 is provided with 

on-scrcen character; a swildi 26 depressable by thumb 28 such dial only those 

FIG. 10 is table listing actions in terms of movement motions are detected which occur during the dqiression of 

versus style to provide control of a perambulating on-screen the switch. 

character as to emotive style; While die subject invention will be described in terms of 

FIG U is a block diagram of one embodiment of Ae accelerometers. it wiU be appreciated to^any means for 

subject invention in which accderometer outputs are used sensing &e motion of device 20 is within the sc^ of A^s 

ditecUy to control the style of a q)ccified action wi&out invention. Whatever motion detection system is utilizecU Ae 

curve matching- and, actuation thereof via a switch on the device elimmates false 

FIG. 12 is ail overaU block diagram illustrating direct ^ indications of motion regardless of cause, 

style/parameter control. Referring nowtoHG. 2, device 20 includes orthogooaUy 

^ oriented accelerometers 30 and 32 oriented respecuvely m 

DETAILED DESCRimON the X and Y directions, the outpuu of whldi are normalized 

Referring now to FIG. 1 in a typical electronic meeting to the local gravitatiorial field veaor G by unit 34 to make 
plac^ s^aacomputergeneniUy indict « device 20 orientation independent, 

a monitor 12 having a screen 14 in whidi a cartoon character The raw accelerations, normalized to the local gravita- 

16 is depicted. In order to control the movement or persona tional vector, are converted from analog fwm to digital form 
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by an analog-tCMligltal converter 36. with the output of What will be ^Tpreciated is that by a series of device 

converter 36 being transmitted via transmitter 38 and movements, vaiiau sections and pexscMias can be in^KUted to 

antenna 40 to antenna 42 and receiver 44. The ou^t of the on-screen character. 

receiver 44 is decoded at 46 to ascertain the i>articular Referring now to FIO. 5 in more detail, acccierometers 30 
motion which has occurred via comparison of the accelera- 5 and 32 are conventional naonolithic accclcrometers widi 
tions transmitted to receiver 44 with accelerations ooxre- signal conditioning. These devices are available from Ana- 
sponding to tcnqulates 48 «^ch have been prcstored in a log Devices of Norwood. Mass. as model ADXL 50. Accel- 
training phase. The matching of the sensed accelerations erometers of this type have general application for airbag 
with the template ^celerations results in a decoded signal deployment in which accelerations produce output voltages 
being q;)plicd to a graphical object control unit 50 whidi |iom 0 to 5 volts, plus or minus 50 G. The frequency 
provides drive signals to a screen driver 52 to control the response of these accelerometers is DC to 1 kilohcxtz. It will 
movement of a character or graphical object on display 14 ^ appreciated that with a san^ling rate of 244 hertz, the 
as described in connection with FKj. 1. Nyquist limit is 122 hertz. In order to provide a robust 
What is provided is a wireless non-contactuai system for system, low pass filters 74 and 76 filter out responses above 
controUingthemovementa-personaofagraphicalobjectln 72 hertz which in general arc undetectable by the subject 
the form of a character thnxig^h the frce-air scnsmg of ^y^^ filtering out any 120 hertz noise 
accclcrauons of a hand-held device. due to 60 cyde AC power supplies. 

In one embodiment, device 20 is in the form of an egg The ou^ts of filters 74 and 76 arc applied to analog-to- 
whidiamomatically establishes an orientation for die device converters 78 and 80. In one embodiment these 
within one's hand. It will be appreciated that Aemovcnacnts ^ analog-to-digital converters arc 8 hit 0 to 5 volt digital 
allowed in the subject context are in a plane parallel to the san^)ling devices in general available as part of a formatting 
plane of the screen, with the X and Y accelerations not only microprocessor 8Z manufactured by Motorola Inc. of 
nOTmalized to the local gravitational field but also normal- Scottsdale, Ariz, as Model MC68 HCU. It is the purpose of 
ized to a plane parallel to the screen. ^^c analog-to-digital converters to convert the analog out- 
It will be appreciated that an additional accclcronacter in ^ puts o£ eacdi of the acceleiometers as filtered and as illus- 
a direction orthogonal to the first two directions, such as the trated at 84 and 86 respectively Into a digital fc^mat corre- 
Z axis, permits the generation of three acceleration vectors, spcmding to recoids. In one embodiment the recortls are 4 
thcrcbytocxtendthenumbcr of hand motions whidi can be long, with 1 byte for each accclcrometcr, I byte 
recognized by the system. reserved and 1 byte for time stamp and phase infwrmation for 
Referring to FIG. 3. It will also be appreciated that the 3^ the beginning and end of a record. The ou^ut of micropro- 
motions of device 20 of FIG. 1 which are utilized to control cesser 82 is provided to a host con^uter 84 whidi provides 
gr^hical object 16 are those indicated by the dotted arrows. a number of prefTOcessing functions as illustrated at 86. The 
In this case, six motions of device 26 of FIG. 1 ate firstof the preprocessing functions is a gravity normalization 
recognized as motions which can effectuate different control funcdon as illustrated at 88. In order to accon^>lish this, the 
scenarios for the graphical object 35 data is subjected to high-pass filtering to 5q>arate out data 
Referring now to FKj. 4A, note that a difTcrent sequence above and below 0.1 hertz. Hie data below 0.1 hertz is 
or scries of motions of device 20 can result in a language to deemed to be gravitational data, whereas the data above 0.1 
control die on-screen character to execute complex actions. hertz is deemed to be user data. It is dicn possible to subtract 
For instance, as illustrated in FIG. 4A. the on-screen gr^hi- out the gravitational component from the user data to 
cal object corresponding to a character can be made to sit 40 provide data normalized to the gravitational field. It will be 
cry, and to do so at a loud intensity. In this case device 20 appreciated that all the data can be represented as an X Y 
is moved to the right to signify through the detection of its vector with the gravity infoiroation being in a given direc- 
accelerations a sit control sIgnaL The first movement of don and die user data in another direction. The combination 
device 20 io general indicates a movement of the grqihical of these two vectors yields an angle by which the user data 
object Thereafter, device 20 may be nK>ved downwardly to 45 may be rotated to move from device coordinates to real 
pound against a fixed surface 60, thereby setting off a world coordinates specified by die gravitational vector. In 
numiber of undanqped transients to provide signals to oontrcd this manner. grq>hical object control can be made indq;>cn- 
the graphical object to cry. The intensity of the crying may dent of device orientaticxi within the hand, 
further be controlled by the movement of device 20 in the It will be appreciated with ostfaogonaUy-oricnted accder- 
shaking motion illustrated by double-ended arrow 62 to 50 ometers that the orientation of the device within one*s hand 
indicate that the action described in the second of the device is irrelevant However, when a third acoelerometer is utilized 
20 motions is to be more intense, v^tever that action is. in a mutnally-oithogonal direction to the dkections of die 
A language is therefore developed In which a first motion first two above-mentioned acceler<Hn^ers. then it may be 
of device 20 may be a direction for the graphical object to important to be able to establish, other than by gravity, an up 
move, whereas the second motion of device 20 may specify ss direction for die device for specifying a rotation about die 
an action, in this case crying with tears coming down firom device*s Longitudinal axis. 

the eyes of the on-screen character. Finally, a further In terms of the sh^ie of the coizq>uter oontrcd device, an 

detected motion may be utilized to control the intensity of important reason for an egg shaped or non symmetrical 

the action, in this case, the crying. device is to give the user a feedback as to what, in his 

Such a language is also illustrated in FIG. 4B in which 60 perception, is an up or down direction or in fact any other 

movement of device 20 up and down as illustrated by arrows predetermined direction. While the system described above 

64 and 66 causes a movenoent of die gri^cal object does not require foreknowledge of device orientation, it is 

whereas quick rotation of device 20 in a subsequent move In convenient for die user in effectuating the hand movements 

die direction of arrows 70 and 72 causes a walking action of he desires to believe that direction makes a difference in 

die on-scrcen character. Finally the same motion of device 63 terms of the device he*s holding. In short, the asymmetrical 

20 as that illustrated at the bottom of FIG. 4A causes the egg gives the user a means of telling die computer a given 

intensity of the action, in this case walking, to be faster. direction. 
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Pteprocessor 86 also provides a time expansion fiincUon between two pauses, and is limited to 2 seconds. Ge^s 

as illustrated at 90 in which all gestures arc notmaUzcd to a that take longer than 2 seconds to coiTq>lete are ignored, 
time scale, for instance, to 2 seconds. Thus if the gesture More generally and refening now to FIG. 6, the subject 

takes shorter than 2 seconds, its effective length is length- process can be described as foUows. Rom a mx^e genera^ 
ened to 2 seconds for con^iarison purposes. In order to 5 point of view, accelerator 100 provides an anal^ signal IW 

acconmUsh the time expansion, half second pauses of less which is low pass filtered and applied to a DACTUART 104 

than one half G are detected to indicate die beginning and whidi is the aforementioned 6811 imcroprocessor to fwovidc 

end of a gesture, with the accelerations therebetween a serial ouqwi 106 coupled to die serial reading port 108 of 

ocpandcd to this normalized time slot the aforemenUoned host conqnitcr. The output of the senal 

ftCDrocessor 86 prior to gravity normalization and time lO is 1°* P^^^ ^^H:^ l]^' f^?''' 

Kcprocessor w> Pf^jP^f^^ ^"^^ ^ gravity being subtracted off via a higji-pass filter function 

expansion perfoai^ a ^8 ^^^"^^^^^ ^ fl2 to reference the accelerations to ttie local gravitational 

a negative 3.3 Gs to a positive 3.3 Gs. ii6. the output ofwhich is recorded at 118 for future gesture 

The result of the preprocessing is ^pphcd to a pattern rgj^gnnioa. 

recognition circuit SM which forms part of the decoding unit ^ ^^^^ ^^^^ ^ 120 which 

46 of FIG, 1. The pattern recognitioD matches the prcpro- ^^^^ ^ normalize the gesture detection system by looking 

ccssed accelerations to tcmpUitcs of accdcxaUons w^ch ^ sq,arate the gestures, in one embodiment by 
have been previously stored in a trammg phase such that ^ i^,^^ o^e half second pauses of less tiian one half G. 

with appropriate pattern recognition the correspondmg out- ^^rcaftcr die data is spUt into less than 2 second segments, 

put commands arc transmitted to gi^hical object control arbitrary length of analysis fca gesture rec- 

unit 50 of FIG. 1. ognition at 122 . Time expansion is accomplished at 124 

In one embodiment pattern recognition in the subject ihrough an intopc^tion and resan4)ling normalized on the 
invention utilizes die K Nearest Neighbor Algwithm, ^ ^5 2 second intervaL The result is a 128 data point vector witii 

which tiic data comes out as 128 numbers which are then ^^ta sanqjled at 32 hertz times 2 sensors and 2 seconds. The 

conqwrcd with tiie distance between all die previously output is applied to the aforementioned pattern recognition 

stored samples as calculated in a 128 degree space. Here die ^ ^ produce the output commands or command 

coCTclation is die Euclidean distance. For exanqjle. given strings. 

tfiat a data point indodes 128 diflferentsan:q)lescoBrrespond- ^ Referring new to FIG. 7. various movements of the 

ing to a single point in a 128 dimensional qpace. eadi of die computer control device result in various prescribed 

previously recorded samples is represented in 128 dimen- on-screen motions for the character or icon. For instance, 

sioo space such diat when a new point in this 128 dimension niovement of hand-held device 20 quickly to die right and 

space arrives, tiiis data is compared to all f«cviously then to die left indicates to ttie system tiiat a character right 

reccffded gestures as points in this 128 dimension space, K required. A left turn is illustrated when device 20 

is an arbitrary number picked to find a gesture oaresponding ^ j^j^ ^ moves to tiie right On the odier hand, 

to that set of points wliich is closest to a previously recorded ^ increased speed is dictated by an upward movement of 

gesture. It has been found empirically diat a good nund)cr device 20 followed by a downward movement of die 

f «r K is ttie square root of die total number of points device, whereas decreased speed requires first downward 

available. Of the K points found, die gesuire detected is diat ^ movcrncntrf the device and then upward movement A reset 

whidi most quantitatively is rqnesented in die K nearest gesture is one in ^i^iich the device 20 is moved in a square 

neighbors. as illustrated, whereas to get toe character to wobble and 

The K Nearest Neighbor algorithm is used to perform die tiicrcfcre toggle between wobbled stages, one shakes device 

pattern recognition con^Hitation required to classify a new 20 sideways four times as illustrated by the arrows. A 

control device moveixient as matching a particular recorded 45 bounce toggle resutts when device 20 is shaken in an upward 

gesture. A database or learn set of gestures is first created by direction four times. Moreover, the character can be made to 

repeating each individual gesture or class ten times and do a figure eight on-screen by moving device 20 in the figure 

recording each instance as an element of die dass. Each eight illustrated. A station )secp or sway motion is illustrated 

clement is represented by a vector of 128 real numbers. in which a swaying nKition of device 20 results in the desired 

When a new ii^ut gesture is to be dassifled, a Eudidcan jq on-screen movement. Finally, a circular motion of device 20 

distance is calculated t>etween it and every element of every ^ one embodiment causes the diaracter to flip over, 

dass of the learn s^ These distances are then sorted in ^^^^ can be seen is diat with a prescribed movement or 

ascending order. A K value is then calculated as die square gesture, the character can be made to perform on-screen that 

root of the size of die learn set as recommended by Dcv^jcr which the gesture controls. 

& Kittier. Pattern Recognition Theory and Applications. 55 Referring now to FIGS. 8A-8J, each of dicse movements 

New York. Springer- Vcrlag. 1987. and whichever dass is of device 20 is placed beside a gra(^ of accelerations from 

most numerous in the first K distance values is determined i^e orthogonally-oriented accelerometers which are die 

to be the matching gesture. cotnbincd ou^ts of the accelerometers in one embodiment 

The Euclidean distance between two 128 dimensional The first part of each waveform corresponds to die ouqjut of 

vectors, is defined as the square root of die sum of die one accelerometer, with the second part corresponding to die 

squares of die dSflferencc of each value; output of die second accelcrometcr. As can be seen, dierc are 

distinctive waveforms which are the resuU of moving device 

9qttaKLJ0(n((M-BlMA2-B2)"+.-.-KAl28-Bi3«f) 20 in die spedfled directions. It is possible tiirough tiic 

A sinmle algoridun for identifying pauses in movement is tedmique described above widi standard curve matdiing 

used to separate gestures for pattern recognition. A pause U 65 to be able to distinguish between each of tiiese control 
defined as motion less than 5,0 m/ (s»s) for a minhnum motions and to be able to effectuate on-screen character 

duration of 0.4 seconds. A gesture consists of the motion control. 
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Note that the decreased speed waveform is illustrated at 
150. the reset waveform illustrated at 132, Ihe increased 
speed wavcfonn at 134. the tum*right wavefonn at 136. the 
turn-left waveform at 138. the bounce toggle wavcfonn at 
140, the wobble toggle wavefonn at 142. the flip waveform 5 
at 144. the figure-eig^t waveform at 146. and the sway keep 
wavefonn at 148. 

What will be appreciated from aforegoing is that it is 
possible to match detected accelerometer wavefonns with a 
training set of wavefonns to be able to specify the action of lo 
die on-screen character. 

In an alternative embodiment once a movement has been 
dctennincd. the style or emotional content of the movement 
is specified directly from gross accelerometer output without 
pattern matdiing. In this embodiment accelcrometa outputs 15 
are directly Toapptd to certain parameters which are used to 
select which of a number of emotions the on-screen char- 
acter is to exhibit. 

Referring now to FIG. 9, the range of human emotion can 
be graphed as illustrated In which valence, the range 20 
between "good"* and ^ad** is g^agixed against intensity such 
that such emotions as happiness versus sadness, surprise 
versus disgust and anger versus sadness can be specified by 
intensity on the absdssa and valence on the ordinate. To diis 
end the outputs of the two accclenxncters can be directly 2S 
used to specify a value for valence and a value f<x intensity, 
thus selecting a particular enK>tion. 

Having decided that various emotive content can be 
specified in terms of intensities and valences, it will be 
^jpredated as illustrated in FIG. 10 that given a particular 30 
movement or action, this action can be performed in accor- 
dance with a predetermined emotional style. In an alterna- 
tive embodiment a different set of ou^ parameters can be 
directly controlled by the accelerometer outputs. As can ben 
seen in FIG. 10. the style of a metric action such as '"move** 35 
or "move until stop* can be altered in accofdance with a 
parameter/style factor which dictates for instance the speed 
oi tiie action, the degree of knee bend, the pitch of the body, 
and the length of the stride. The result is a style of movement 
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which can be controlled for instance from a march to a stroll, 
to a canter, to a nut and to a totter. 

This being the case, it is possible to control not only the 
movement of the character but also the style in which the 
character moves on-screen. As a result and referring now to 
FIG. 11. it is possible once having specified a particular 
action such as a walk or run. or. etc.. as illustrated at 150. the 
output from the aocelerometers may be used directly to 
select a parameter or style as illustrated at 152 such that 
when this parameter or style is normalized or scaled to a 
particular parameto- range at 154. command strings 156 arc 
generated to modify the param^ers of the currentiy specified 
action as illustrated in 158. 

What this means Is that assuming a walking action has 
been the specified action, tiien by simple movements of 
device 20. the accelerometer outputs may be interpreted 
without waveform matching and merely utilized to control 
the intensity of the specified action, or any other parameter 
which is convenient 

For instance, referring now to FIG. 12. the types of 
parameters which may be changed in accordance with the 
ou^t of parameter/style control 160 in order to effectuate 
changes in tiie specified movement or action 150 are bounce 
160a. the degree of joint articulation 160&. speed of move- 
ment 160c. position of center of balance 160(i. length of 
stride 160e, degree of wobble 160f. or any otiicr type of 
parameteL Thus once tiie movemeDt has been ^>ecified and 
a gr^>hical object control 162 has had the approbate inputs, 
then the screen driver 164 is utilized to drive display 166 
such that not ooify is the on-screen character performing tiie 
specified movement or action, it also docs so with the 
particular style or parameter specified by the direct utiliza- 
tion of tiie accelerometer outputs without pattern matching. 

Thus, the hand-held device can be used either to q»ccify 
the desired motion of the on-screen character or icon 
through pattern matching, or the hand-held device can 
sixq^y specify style for on-screen character movement once 
a particular movement has t>een selected. 

A program listing in C is now presented to farther 
describe the operation of the system: 
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sgest.c 



I' 



• Main may potnt lo wood. 



• fiorrin B. Jewell fh^l9Mi.com> Fri hfei^ IS 0i:}6-06 f904 




ffirtmcr posix source 

Mcffaw "posix" SOURCE 
Icadlf 

ilMh»4* <Mdio.h> 
llachid* <erTno.h> 
llDclBd* <uring.h> 
flBclode <iidlttLh> 
llBdude <un(std.h> 
llDCloda <st8nal.h> 
flaeind* <tbne.b> 
tiaclitdc <iusen.b> 
llochidt <niMhi» 

/• for sM!*a •/ 

llndudc <%i\ /tlfne.ti> 

llfdBf Irt»3 I* hack to gel teket under POSIX •/ 

lloctvdc <sys /9deci.h> 

Hodnto "Mrio h" /• itnei port rtedlnt 

tIadiKl* "Idau h* /* Aikt flte lurutUnt * I 

/"•- 

ftr rdcfUicdrsuM)) 

Idcnu SIO PORT Vd«vAty»>' IHh'i put in ponna •/ 

lir (dcnn^irii) n dcniMdOrllS)) 

fdinnc S10_P0RT Vdev/tiyUZ" /• Don i pm in porau */ 
Itbi 

IdtDst SIO PORT Vdcv/ttyi2" /• />Dn*i /wu « ;wr**u •/ 
feadlf 

iudir 

^» 

• StO_POKT dtfimt A* Jfi*»»oit« o/ lA* uriai pott 

* Jfvjrr fJh* t«<nd if fomMWd tti. 
•/ 

tdcflM SCALE X ((7.4 • 9.*> / 2J6.01 
tdcflm SCALE"y «7.4 • / 256.0) 

tdcflDt OFPSEf X (-128.0 • SCALE_X) 
«dcflat OFFSCTIy (-IJfl.0 ' SCALE_V) 
/• SCALE aad OFFSET /otters art ustd to eoMvtrt 

• 7*# tatitj of /h# w*ni ttiuon. {c»rr*fitiy 

• eaUbm^ to product fO lo 255} pr 
► «c*/«mfiOM -/.J to *J.i t's) 

* jlrair u appiitd first and ihtn \h£ offttt 

* Tkrf convert lo m h'i which it whet m< utf 

* for competiset* and is what it tavtd ittto 

• (A* $rftun dam files. 
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sgest.c scest.c 



HtnM NFTS (64) 

/• The nwthtr cf (x,yt data poinu to MwW to 
■ i/m grtlttr* rtcotniur, 

* This is a tisth mart than 2 smudt worrA n/ data 

* f6J I SO S Hz) m 21 SMildl, 

•/ 

tdtamt SUB5AMPLE (8) 

/• SUBSAMPLB l» th* rtt*€ €n whit^ ¥m rtsamplt Jam tuwif 

* a moving mtragf tow post filur. 

* /n this mu; rAc input from iht wmd is SAk4PLE JfZ 

* (furtmlty stt ax ohoul 244 kz) 

* tmd and a Mubsampte mtt Iff 8 ftvit as {244 f S) « 30.5 Hz. 
•/ 

MAO ZERO TH (50) /• m h't • / 

; MA0"ZERO~TIME (0.4) /• fctmds *f 

/• 7fcr« two~MAGZ. tifftrnt control the ihrgshoUt 

* for rrcognizmg fouse* betwewt tesiures. 

* A pmae is dtfined m a mognitode of itMt Oian MAG^TEftOjTH 

* for at ieast UAC_Z£ftO_TiU£ duratioit. 

* MAC ZEKO T is Just set fhm the ato** vatuet. 
•f 

ffaflM MA0_2ERO_T ffUi(M(MA0_2£RO_TIME«SAMPLE_HZ> /frtlartlSUBSAMPLEl)) 
i* 

* POSnC and AUSJ C don't octuaJff cati for n to be dtfined. 

* but wt nttd it anyway. 
•/ 

M <t dcflo^(M PI)) 

$4eam M PI <3.UIS93653SB9793238461 

•co<ir 

/• 

* The maxiMum aamber of data fUgi Ihtt ecn he 

* used to the comnand tme. 
*/ 

idcnor MAX_OESTURES (IOO> 

/• Thfst fumetiem on the mtrmet to the pattern recognizrr •/ 

txltra veU ur iaiKinl Tc that *fvt]): 

citcni *oM urrepectflBt fc. ckar •fvpilMt "nwch): 

ertini void sir~cleanup(v«M): 

/* eomtmortd tine * / 
void 

u»ge(cliar trosname) USQgt 
I 

rprfmnstdcrr, 

"usAge: [-pon <portiutme>) (-$B»t <ouilile>| |<diiiftle>^D". 
pfOBname); 

rprinifTctden,"M -port defiultl lo %sto".SIO POH'T): 

I 

ctar tiTKU^kUf - NULL; 
ctor •crndfoMi = NULL: 
lat cmdfrilee m 0; 

Apr 6 12:0} 1995 Pcgt 2 of Sitax 
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sgcstx 



cfaar tmdl.nievlMAX.CBSTURESI: 
Inl 

fianc cmdlineflal arse. <hw ^argyf]) 
I 

111 i; 

for (i " 1; i < argc; ( 
If (CUrH'))) — *- > I 

ir 0 itfcnipl"-port'afgv|il» ) 

cfndijxKi a afgvl+*lj: 
I dw ir (! urcmpC-geWjirgvlil)) ( 

cmdl tdaf a argvli-'H]; 
J tli.'( 

\ 

I ctii I 

cmdl niBvJemdl filec+4) = afgvlil; 

I 

ir (rctni«_port) cn»dl_port » SIO_P0RT; 
riinnkO): 

i 



• rraiff wonci jfV>u/ oiuf ^1 lonu prtKtstbtf. 
■ /J CYiUf Jl9_rvi]cfrj fo t'* rteorttM from ifu 

• mind attachtd to a serial port. 

• This 



sgcsuc 



parsejL'mdline 



t 



• rroilf of moa mttai2 paints, bui 

* extra room In xdta and ydta for 



il netdt the 
protessint 



read itow timaliiot T f. 



noat *idu. 
noat •ydta. 



lat 

noat *it. 

noat •ya. 

flwt *KX. 

noftt *B7. 

riOBt xicale, 

noat yiMlc 

float KofTict, 

noat yoITicO 

sio_rcc_T rewISIO.MAXREADl; 
tttt nread: 

nread o jiQ_rc3<Kf Jtci.ndit'Tacciini 
ir (nraxl > 0) { 

lot nout; 

rcglsltr IbI o: 

nout > rnfeid-ff^n*))/^!^^!!!!; 
n ■ nifia-noet: 



do filekmdfe '/ 

/• (TAf A (if xdja and >tfta on7J ♦ > 
/• Jf aneleromater data army ♦/ 
/• Jf o«f/*fwnff«r data array •/ 
/• muvvif av*rai* siduompie rat* •/ 

/• state HtriabU for «ivmf dM^f' fcw po" tuhtcmpier • / 
/» itote wrioKr «<»*tf wsragt tow past suhuanpier • I 
/• xtofv wfiflWr /or *K»*if ovrraf* fcwr pou wftjonvter • f 
/• iour Morfotfc for x jro>«iy paw fitter • / 
/• jtofff variable for y travity tow pass fitter * I 
/• seats factor for input s smsor dattl • / 
/' scate faexor for wptis y remtor data • / 

offiel voiue fow iapttt x tensor data (afler scaled) * t 
/• efftet vatum fire inpas y tensor data fitfirr saded) • / 



ft); 



Apr 6 i7:0i 1995 Pat* 3 of sgsstc 
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sgest.c sgest.c 



/• wm actttmtiiaton. if apmpriate * / 
II l»ni Of) I 
•xa « 0.0; 
•ya a aO; 

I 

/• shift over cR the oU data •! 
\ 

Bl i; 

(i > 0; i < n; ( 
ymtfU « ydta[li-nout); 

) 

) 
( 

KgUter u t: 

for ti » 0: I < niwd; ( 
i 

float 
float 

/' |tfi juw ^fs Md MoJt a^aprkatty * ^ 
X 9 (4noat)>ecini-«dl) * xtcale + tofftrt; 
y n (4rhMl)teMni.vBl2) < yicate' + yorrset; 

/* JUur Jbr tntvtiy * / 

- 0.01 ♦ aw*8y): 
/* XH^MC/ 0^ grevitjf from data * / 

» 

/* acccpf ovrrtft* t'^. miUMt nlattn to trovitf * f 
it (♦♦(•t«) >= nacctitn) ( 

float {ly; 
Osat pmtg: 
float [tttic 

pt » [*xa/((flnn*nt}l: 
py » (*>» H(ClMn*n«»: 
pmaft - •qrt(pa*pK*f»*t*y): 

ptb - (pnuf > 0.0) ? itsnifpy^) : OiO: /* kJuhW w dleWrt • / 
pth — {(•»» »■ aO) ft* <»By !» OlOI) ? iiin2f»gy.*gi) : 0.0; 
pen +. {UJirm. 

/• Rf^-fiK^ prt » fcr f-P/ < prt <= /*/> 

* H OotWt meatr loo muck smee it 

* is tuamufd to br near. 
*/ 

wklk (pih > M PI) pUi — 2.0»M_Pt; 
wfell* (pth <- -M >) pth lO'M.PI; 

I* ptk is now rttaHH to /raviiy • I 

ydl^fi /(■na)hfl] - plh; 
•in • 0; 
•»* a OA 

•yi - o.a 

I 

1 

I 

rclBra(noui); 

Apr 6 n.Ol t995 Pagt4ofsi*su 
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sgest.c sgest.c 



) 

rcturnCnrcBd); /♦ error or nftnc rnui •/ 

I 



/* nit progrom is intended to b« stopped wtiii d 

• Ort-C at wWrt point U xnvs off U'l data 

• JUe carrectty. tf a second Ciri-C is iuued, 

• ii Hfff exit In the middte of saying ihf data file. 
•/ 

lUtlc Inl qtiil_nig s 0; 

stiUc Told quit sighandlerfvDid) 

i 

quit rUg = I; 

I 

•4alle ttnict »iBactlon oAct; 
stalk stracl tlgaciion act; 

static voM KTnp quit iigtiandleiTvftld) 
1 

an,sa_haftcller «■ quit_slghandler: 
li gempiyaet(&aciLu_misk>: 
aci.aa_nagi * O, " 

usactton<SIGINT. Aact. Aoact); 

fpri«f(nt»erT"SeDd a StGINT signal fTypIctUy Cirt-O to qjti.Nan: 
9uli t\»g = 0; 

■latic 9oi4 cleanup q«b ligbmdlertvald) 
( 

sigictloitfStGlNT. AoacL &act>: 

I 



/• Expend army 2 to emy 1 witteh may be of dtfftrtnt 

• lengthM. Linearty imttrpolasei the dam m/uca 

• if makes the first and tost retMes of dtat 

• etpMd to the Jim taut teat values dtaZ 

• which f don't tfank Is strictiy valid... brnt that 

• yuron't httrt is any. 
•/ 

void 

linear interpolate(aast «dtaU M duln. 

nast Mla3. iDt dia2n) 

I 

atsen((ltal): 

8ssen(<haln 0>; 
aucit(dli2n >- 0); 
asseitldtaln >- di»2n); 
I 

r««latcr la* i; 

for (i a a i c dialn: I<m-) ( 

nast rwu: 

n*it frac; 



Apr 6 n.-OI im J oftgeste 

-30- 



08/08/2003, EAST Version: 



1.04.0000 



23 



5,757,360 



24 



SRcst.c sgest.c 



) 

I 

) 



iat 

fidx 3 (([nMt)i>/r(nMtMdlatn-l))}*<(nMtlfdu2A-l)); 

klx ° tiBlMloortndx): /* mmoate */ 

frac B niJx-<(Roal|ldx); /* utkr pmUotiot port • / 
ir (idx »> <lU2a-l) t 

<luil[i) ■ du3(idt]; t* jtat in case,, to wt don'i ottrrm arntv •/ 
} «U« I 

dtalitt = <ka3(*JN] *■ «du3(idi<i.| ) - du^t'd^l) * froc); 

) 



rtalic Idi^T *»daia = NULL; 

e«i.init)T*id) gestjmt 

it (cmdl IdftO t 

Usta o Ida iiiit(3*Km. rrfna*l]SUBS AMPLE) / SAMPLB_HZ)): 
I " 



* gea handed ikt pro€fV*d orntyi Jbr mrage 

• fnte data Jtlts or fitr fKYtwrv rccpfAMoa. 
•/ 

v»M 

Bi^st store(lBt cent, lal t. Iat bgn. lot end, ftoat *icdta. IImC •ydul g€Xt StOre 



/• OJJCFKi'JR >- OJf •/ 

MKTtfcnd < NFTS); 

rprinirruderr.~Cn(niaring ddi rrotn run <%dX time {%d'\ [%d.4d).Vn*, 
ecMJiifnjeiMtl; 

If (t < 0) ( 

fprioinude>T,'Noi compuins dati from negative iime.\«"); 



If (b«n < 0) { 

fpriotRsidea.'YjcsUtra ttaiti before airiy. Not (torin(.\n''); 

I 
I 

Ami iniicl)(2*NFrS); 

/« cDfiMTf from poktr koek ic jity eoerdimaui *t 
\ 

nglrter tat I; 

fMlisO: \ < end-bgn; I 
no»c mt|^ 
nosi tb: 

Dtas • utT&[bgt>^l: 
lb - >du(t>frv+i1; 
sdta|bga-i-i| =» inag*cot(ih): 
ydi»(^4jj a mag*tin(ih1: 

I 
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sgestc 



KnearJmcTpolaieiinaich, NPTS, ft(id]8|t>gn)). end-bgn); 
lincarjmcrpolaief ftf natch! NPTS1). NPTS. ArydtklbsMl). cnd-bjn): 
spf inif( vuiianis,*'nL9W)3d %05d. %(Qd,%0}«l'.ccnt.i,b|n,end): 
if (cmdl tdaf) | 

If (Wa_»«K«(Ul«».vinwiine."no_u(ilw'.-4[).0,40.0, match) < 0) ( 
rpfiatffsiden.'Uiubte lo store v»r \'^A'\ii".vimuine): 

I ftlM ( 

rprtmfrsiden.''5lore(l v» \"*s\'\n'.vann>rat); 

I 

/• BOW ewnpare.. grr. tprtih takes doabhs, nut Jtoats 



i 



noat dmatch|2*NPrS1: 
nftiltr IbI i; 

for (i - 0; i < 2*NPTS: ( 
ilmatchti) ■ mitchfll: 

»if_report(cmdl_rikcemil_rilev/Jm«tch); 



„,gest store 



* Thit must *f eatUd whm you an doa» to tave 

* off tfu itttufwt iter wrr€ uond by gest_ttore(l 
*t 

geil Mve<v«M) 
I 

ir (cmdl Idaf) ( 
thnr "iKifTlOO}: 

iUncpyltburxmcJl Idif.lOO): 
ibuflWI - V)*;~ 

fprimrtitderr'Aliempliiii to write file: N'ftjWjihttO: 

If <l(ti_save(l(Iaia,tbur) < 0> | 

pefTOr<"Em>r wrtlinf flte"); 

nirtmfCstitOT.'Falted to wrt« file: V"»A"ViMbur); 
1 rla* I 

fpriMHudcn,''WrMt Hk \'%i\'*\n',UHir>: 

) 



gestsave 



maindot argc, c^r *vgv(]) 



I 



if (pafte_emdlineftrfe,Bfsv) < 0) ( 
uiagdirgvton: 
tUi(l); 



>if_imi(cipdl_rilecxnidl_ntev); 
gest initO. 
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sgcsLc 



sgest.c 



siof_T f; 

rr (9io_open(&f. cmd}_pofi) < 0) ( 
pcrrotCUMbh lo open sctial ponl; 
rctuTBtl): 



(iMt *xdu: 
Roal 'yftu: 
lone t: 

IdI npis e= NPTS: 
lal ccni - (V. 

idta s fflMt *tinallDcfnpti * dzMftflMti,); 
ydu B fnoAt •mullDCtnpts • aiznirilMt)): 
usertfsdu jdu); 

ictup_quit_si|{h«Mncr(); 

whlta (! (|uil_fbg> I 
lat •rTW_i1i|; 

no«t kmT 
nut 
nut Bx: 

Hut BV^ 
lat na; 

■■I t_l«st_sero_eng; 

/• r4Jrt~ thg'dakM v»eton * f 
I 

rtdsttr lal I; 

hr ( i s 0: I < npu; ( 
KdufU » OlO: 
Tdtttn - 0.0: 

] 

I 

/• «j#f iA» ^ff#f ittin vorr 

■ as 0.0: 

Ki * DO: 

B* • <J.O; 

jy - 0.0: 

na - 0; 

/* rrjTf ivnr •/ 
t ■ -npu; 

/• inerrast tha error count • / 
erTDr_nag ■ Oc 

t_l*«_*ero_ena ■ t; /• umm of tost irro twjf ptriod * I 
zcro^eng^CDum « 0; /* catuu of this ttro enerfy period * I 

iffd]c(?qutt_n»B &A \ mor_nts) I 
Int nrud*. 

/* block on ttriat port iapai 
• Ttcknkaay, ihU is not POSJX ctmpatibU. 



tA set readfds. cxceptfds: 
lat sfru 
ittt «: 



«fn « tio_Ricno(AO: 
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sgest.c sgestx 



FD ZEROAreodriltr. 
FD^ZERCXAeiccpitdj); 

FD SErt»&iArr»i*ftb); 
FDlSET(»fn,Awiee(rtrda); 

ret « sekcttFD SETStZE. Areidrdi. NULL, fteiceptrds. NULLX 

I 

nrcad • leod »tow_diiB(Af. npa. nAa. yAt. 

SUBSAMPLE. Ana. Axt, Sty*. Agx. Agy. 
SCALE_X. SCALE, Y. OFFSET_X. OFFSET_Y ); 

If (nrcatt < 0) ( 

penorTtUu readtnn enw (pmhaNy «rraininii)"»: 

error nag b I: 
) slM Ir (nread > 01 | 

reenter lot I: 

t [uead; 

/• Mt w^k for pttustt in this loo^ * / 
for (i a 0; i < nread: k+) ( 
i^ffUtcr im tnarpu-nread+l: 

/• cotaa the tength ofitrv eng * f , 
If (uJutwl < MAO_ZERO_TH) ( 

/• if it's h4tm trro for tmmmum amount of time • f 
ir (wro_enB,ei»onl++ > MAC_ZERO_'n ( 

/• if we're not Siiti tn sane zero stored off atrtady • / 
l»( stare(caii.t, 

tJ«st_«ro_eng-<, 

tn+l-zero_eng_cou«, 

&<t)«.ydia>r 

t test zero eng = t+tn; /• ttore ax end ef Uut zero energy • / 
I " " " 

I lilt ( f* mog not zero * f 

zero tag count a (h 

I 



I 

I 

ctcamip_qdi_ti||Kn4erO: 

rres((vofd •)«<Jit); 
treel(«W •)ydia>; 



If (tlo cto»e<AO < 0» ( 

(lenort'Unible to cVmo vtAt\ port"): 
r>lurm(U: 

I 



08/08/2003, EAST Version: 1.04.0000 



31 



5,757,360 



32 



sgest.c sgest.c 



sif_clearui()(1; 



Apr 6 12:01 1995 tOofss^t.c 

-35- 



08/08/2003, EAST Version: 1.04.0000 



33 



'5,751360 



34 



siface.c siTaccc 



/* 

* This ftte cmiaiM ihe entry point to 

* Vir patttm matching roatmes, 

* Darrin 8. J*wrU rt*^n9hdi.cfm\ W,^ i^- < /A-JS.» 1995 



tiradtr POSIX SOURCE 

rdcnoc 'posix~ SOURCE 

UmAit 

flndndt <udto,h> 

VIacIimI* «emMxh> 

llodsdc <um)|J)> 

ItDdwte <siclHb.h> 

ViMlMta omtoidJD- 

llodide ctiKiui.li> 

Itodoilt <iime.h> 

llodadA <tis»ctt.h> 

tlacliid* <ffl»th.h> 

linclBdt <kneightnr/kMlghter h> 



NkIIk MATCHLHN (1»> /• man nunrA 2*^P7S in •/ 

Btstic 0ATA5BT_ftANK Mb > NULL: 

/" tnitiaHuition rciame, gen handed m 
" orfv^artc styU iiu oj btti data files, one for each 
* t'Ottre fn the team set 
•/ 

lif inittlDt fc, cb»r Sif iftU 

\' 

rprinir(SKtnr.'*Initlitlziiig IC Nc«r«j Nelgtibor cUsnrier.^n'k 

fprtmniKkrr.li with r%cO cc4iure».Vft'.fc); 

I 

lat t; 

for (i - 0: i < fc; ( 
rprimnftdm. Vi«i\a V%ri I); 

I 

I 

ir ffc > 0) I 

db = reaJ.dKuetsirc.rv); 
aiscr^db); 

» 

rpHntrdtderr.'UDofu reading nies\fi"): 
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siface.c siFacc.c 



/• 

* This ftts ea(/#i vitk am arry of floats. 

* to compan a iww fttlMrt ivtfA tSg ^rvvktu/y- 

* ioadtd ttam m 

' /r /A^ sltouid Have thr staru valtus as wtitn lotidt^ above 

* w sifJniHl 
•/ 

itr_reponftBt fc. eluir *rv(),ll««i *in*u:h) sif rtport 

* ir (db) I 

tat ncompifc^ 
tat "iMled liii; 
tat k; 
tat cUss: 

sodedjiii * k_coinpu<e(initch, MATCHLEN. db. Ancompaie): 
auenf sorted Jill): 

k - <lBi)K]n((f<o«klt}oaHn(Mrc)40.S): 
lIus b k_beM(9oned_tIal, k); 

frtcdortcdjist): 

asMrtfctm c fc>; 

^rfntrrstdcrr. "KNN majority shows: («d) <%slta'. 

clau. ivtclanl); 
rT1u&h(sukn); 

rprmtflstdout. "USES %i\n*, M^ulh 

rnush(suiout)c 



I 



• This must b€ etdttd wktm ytm are d«nt. 
•t 

iir_ei«»nuii(*«»d) 5ifj:leanup 

If (lib) ( 

ficc datasci bAiik(A); 

I 

1 
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scrio.h seno.h 

" t 

/< Oarrtn B. JcvtU \iewtit9bdixom} Ttte Sep IS 21:09:44 tm 
♦ Fmaims to rtad WAND teriat oon ttntn 



iirndtf SERIO HJNCLUDEO 

id«i]M serioIhjncludeq 

f* for wmiol sincturt *l 
fhKl«4c clcnnio*.h> 

/.••••••••••*••*•>*••««*«*•*•••»*•*«••«•** 

lypcdcf itrad tior_T_itiuct nor.T: 
/• An %io ftit d»scrip»or. 

* Th*s* nftS (o bt attocaud by iht uur before 

* catting Miojapenil and frttd afier caitint 

•/ 

cxura tot tio_open(»iof_T •f. ciwut char •paih); 
/• TaluM poiniir to an tio fit* JtMcriptPr F. tWwcfc ih* 

* caSttr mutt henm alrta^ atlocaud. A opmt PATH 

* as a strial pott inpta for rtailing rtconts 

* from a weuui ierturt exttmat JrviCf. TWj *^itl 

* ut ifie correct parameten for teriot perr commanicatiem. 

* returns: 0 on jucrcu, and leu trmo on failm. 



•stern Int sta_clote(ttof_T *n: 

I* Takes pmnstr to a previetisiy opened sio /Ut dtscriptor F 

• and restores its orittaal cotnmmiauion pamimen that 

• were saved pom a previous siojoptt^f catL 

• rtmms: 0 on succtis. ~l and stts *rrw oa fmlttre. 
•/ 

typadcf ttntcl wo fec_T_itn»ei ( 

oiulgiMd chmr vail; I* firu vattie rtod */ 

antigacd char val2: /* second value read *f 

DDtlgsc4 chw vaI3: /• third vaiae read • i 

\ »to_rec_T; 

(* a data slructmrt maed to {el rmeorAs mOi sio rwv^J 
•/ 

ntern Ist sio rewKiior T *r, lio rac T *na. lat n): 

iitnm SIO^MAXREAD (311) /* maxuaum nwnbtr of records rtiptetuAU 

Ttites p^tet to a previousfy opeutd sio fiU dtKnptor P 

• and pointer to on orray of RECS ttrveturts of length It 

• that will reetivr data. At m*J» StO_MAXItEAO reeordt 

• will be returned, (f en trror is murmeJ, the mest 

• reod y^tt atlvnpt to re-^ramt the nadmg of records, tmd 

• data may have betn tosL Vdi eati mU not btock, but 

• mar return 0 if M fiilt record is ready tut no error iias occttred. 

• returns: nwrnber of records read or -I and sets ermo on faiiurt. 
■*/ 

rrtcrn Int sio file«»(»iof_^T •0; 

/• Takts pointir to a p^viousty opened sio file descriptor F 

• and returns the number of the tads file t^seriptor that 

• II octuoSly bewg read >twt ThU is suitable, for example, 
' fbr a seiecul call » determine if new data hax orrived. 
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serio.h serio.h 



* returns: fileao on ntcceu. -I aad sets frmo an fititnrt 
•/ 

/* The nut at wftjcA iW data it tjsptrtrd to ornr* from ihr wtmd. 

* This is timpty ih* £ ctock divided by A* mi limr 

* intemtpt rait drnsef as nmfigmtd en boont ihg 68tl 
*t 

Mtnnc SAMPLE^HZ r2 0t6 / ((n(»IHl«l 1)» /* 244/40625 Ht */ 

/*—••••-• .«.....*.....•**•.../ 

/• bthn^ hrrt is pn\n3U infi/rimtiom, lAtir ihiMitd 

* not iff muctud wiih txctpi in serio.c 
*/ 

i6»nw» SIO RHCCIRD LEN (d) f* ImstU ttf won! at cmI atcrou itriat tU^m * f 

IdtDac FRAMENO_MASK ((hOO /* m/id bits of tU fmm^no couitter • / 

•tract slof T smm | 

imi fd; /• ttmit fiit dtsctipurr * / 

•tract tennios old^tenslos; (* lawm srriat line params for resiorr */ 

f tract (enruos new_termtDs: /* atrrtnt striai Uttt /vramt wiUtt open *f 

Imt relrime: " /* nfnoM ncords en timn nod * / 

OMlfDed cbar Trameno; /* segite/uiet Jram» ttmutr * / 

unilKd char p»ttS)0_ReCO(lD_LeK-l |; partial rteord *t 

lot npart: timber ^ vatid vatims la pan * i 

I: 

fdcflu sio 5leno(n ((r)->tU> /• n# abovt •/ 



fcDdir /• SERtO_HJNCLVDED *l 
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serio.c 



/• Ottrrin B. JtwtU \jfwel\9b4icim\ Titf Sep /i 2t:m:44 /9W 



■ Fumriinnt in rpnd WANH tt^inl ntirt >lnM 



tttndtr POSIX SOURCE 
lAennt ;iroSIX*SOURCE 



/• /or Jpriniii * f 
M«hid* <xtdio.h> 

for ap4n(} •t 
tlacloilc oy» ftypcifco 

flocliidc <fcnU,h> 

/* for trror reporttni */ 
IlKhidc <cmnoii> 

/• for eloittX nod() •/ 
Ifaehtd* omisld.ti> 

t* Jor termios tiructurt, 

• Ksttaart), tegrianrf). tfiertsptedfl <fjttotpetd{K 
*/ 

Itael«d0 <tantM.fi> 

for osnrUt * f 
ttBdad* ouen.ti> 

flDdodc -^rio.h- 



I4«nat BPALSB nusli^ IMSXD 
IdtHat BTItUE rBPALSE) 

Mtns* BSETf,blcs,._ni»k_._*tl_) N 
McOm SENS_EPS (0.11 /• •/ 



t* it is a naero in th» 
ittBdef slo_nieM) 

uo fllcno(sIof T "0 
! ■ 

rcl«niir->rEl>-. 

I 

Ik! optndioLT *f. conn ch«r •p«h) SiOJ)pen 
{ 

If (10 i 
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scno.c 



scno.c 



...sio npan 



crmo B 



EPAULT; f Bnd miirttt '/ 



r«lur»(-l); 



$lof_T siof; /• hoki fiU luvit evtrytfitfig o-ot * / 
tiotM = openfpMh. (0_RDWR 1 O^SfOCTTY)): 
If riiof.tcJ < 0) 1 
rcluraC-l); 

I 

If dcgelalUtwof.fd, ft(»iof^ld_tefini(M)> < 0) ( 
IbI eurvc * cnno: 
closcfsiof.rd): 
ermo « suve; 
r*ter*(-I>: 



/* MckM a copy d ttt ttrmioi to modify * f 
9k>l'.new_terintos » |[of.okl_lernHO»: 

BSETf»iof.n«w ienm«.c iflag. BWCINT. * &FALSE); f* iiUgtTttpi on irto* •/ 

8SBTi(itori»ew"iennk».c~lfb|. ICRML, BPALSEJ; /• V -> W donon •/ 

BSETt»ior.i»ew"tefimoi.c"iIltg. IGNBRK. BTHUEJ: /• v">« condiiian •/ 

BSETT»ior.new~iennjOiX~ifUf. tGNCR. BFALSE); /• ifore \r •/ 

BSEn»iornewItennloi.c"iriaf. IGNPAR. BTRU£): /* iptort parity em •/ 

8SETfliof.new_«nni«,c''ifU». INLCR, BPALSB); /• Nn -> \r xlatioa *f 

BSFItiiofjww_»ennio>.cjn4g. INPCK. BFALSE); /' emMt fwiJy etuck • / 

BSETtiiofjiew icnni(n.c inag. ISTRH*, BFALSE; /• J*n> « leven bits * i 

BSElT»tornew'tenm«.c3nas. IXOFP. BFALSB); /• eaobt* Hart fsup input * / 

BSETftiofjiow'tenniM.c in^g. IXON. BFALSE): /• *noW# Mrf fstop otdfml • / 

BSen»»f.new~ientMo»cjnai|. PARMRfC BFALSE); /• mark pcHty trws • / 

BSCTTMor.ntwjenniM.c_»nat. OPOST. Bf>ALSBV. /" ptrform outpia proctixlmg * f 

BSCTtwornew tenBioaj:_efla«. CLOCAL, BTRUE»: f ifnort moAm sumn Untj */ 

BSETtiiof.ne*jenfuofcC_cn«*. CREAD. BTRUE); /• «ttebU /wr««wr •/ 
aSBT(Uofji*w jenniof ,c cfltg. CSI2E CSt): /• Hwnhtr of biu I byta •t 

aSETCuoTJMW lenniwc ellig. CSTOPB. BTHUB): i* Snd fMO nop bitt. r/« «i# • / 

BS?r(iiar.new~ieniiiftt.c~cna|. HUPCL. BTRUB): t* Ham on kut dou *t 

BSCT(>tof.lKw'ennl<».c"cna. PARENB, BPALSEi; /• Paritf cnobfr •/ 

BSET(liof.i»ewjennioi.c~cnn. PAROOD, 6PALSE}; f* odd pariijt. tbt <vm • t 

BSettriorjicw lenniMc in«t. ECHO. BFALSE); /* EmMt «rAo • / 
BSETttiof-new'ieniuotc'inag. ECHOS. BFALSE); /• Eebo «roM» as boekspac* •/ 
DSETtMt>f.n*w~ienni<*c'in»8. ECHOIC BFALSE); /• £cko Utt •/ 
BSETt»iof.tww"iermie«"in*8. ECHONU BFALSS); f ttho \t' *f 
BSinXsior.new~(enRio»c'irui. ICANON. BFALSEi: /* Outaenket iapat *l 
BSET(tiof.new"lerml(»j:~intg. lEXTEN. BFALSE): /• CTOAte exmdtd fiaictKmi • / 
BSCTttkjf.new'iermloixlrUg. ISia BFALSEX /♦ Eaabtt UfnaU *f 
BSET(iioroew"tennioi c_in*B. NOFL5H. BFALSE): /• DUabtt flush nfitr («. quit, susp • / 
BSETCtiaf.rKw^ienniojxJflM. TOSTOP, BFALSE); /• S^d SICTTOV h' backgre^ output • / 

f thit is important to Am« JCANOM sri to FALSE abovt * f 
f* siof.n0w rtnntoif cc{VtNTRI » •/ 

itor.ncw ienn*oi.c.cc(VMIN) * Or, minimvm ntmbtr nf cban to rtadl) • t 
/• slttfM*wjtrmios.e_crtVQUm a •/ 
/* Mipf.nr>rjtTTTUOS.e_ectVS0SPt = *f 
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serio.c '"-^ 

...sioypen 

skif.Mw_lcrmioi.c_cctVTlME] « 0; /• ttnrhj of teconttM betwttn «<«<f) * ' 

/• iwfj\r>y_iermUa.t: ixiVSTARTf - • / 
xiof.new_urmma.c_cetVSTOFI - •/ 

/• 5*/ outimi baud rars * i 

If (cfl«o«peed(A(iiof.rew_iemjKnK B06no> < 0) ( 
Inl csave » ecmo; 
cUne<srar.fd>; 
crmo a etave; 
rctarB(-l); 

I 

J* 5*t input batid run • / 
If (cfsetiHieedlAtsfcr.new_iermlos). B9600) < 0) < 
lal csiive s ernio: 
closeliiof.fiD: 
crmo ■ essve; 
rcuira(-l>; 

) 

ir ftcaetwtrUiorrd. TCSAFLUSH, AWoltewjctniM]) < 0) ( 
Inl cuve = etrm; 

crmo a esave: 
rclnra(-l): 

) 

/• tethnktifty, wt migk warn to to a tes*to$trf} and 

* eonipart to mak* sure thai iht chonget stucK tinct 

* tcs*tanr() con ttUt mtMra w to trror if anyOung warttd. 

* hat wt'rt tofy. 

* / ■ 

ciof.rtfrtfne s I: 
liof.npait a Gc 

f a stof; 



Scloscfsiof.T .f) SiO_Cl0Se 
( 

ir (!0 I 

«nT» - EFAULT. /* Bad addreia •/ 
r«tani(-l): 

I 

/• this should clt<tned up md Jix*d for €m>r chKkmg • / 
icMBittr(f->fd, TCSAFLUSH, A(f->oldJ»nwMH: 

f->fd = -I: 
ntttrm(0): 

\ 

/* klaket an asttmpt to rtffom* dam. 

• mvrm 0 if svcc*stj\it (also eUarx fii->r^amti 

* if success otd poTtiat data it fUuhtd. bur may Itave ww. 

* fittshts dam vail it stts a fntme bit 

• mums -/ (T frror, or I ^ mnebtt to find fromt in 
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serio.c serio.c 



• StO HtCOHD Uf/CTH chars. 
•f~ 
vtaUc l»t 

■io rcfnrae(uaf T •n sio refntme 

i ' 
ir (ID ( 

crrno « EFAULT: /* 8a4 adOras * t 
nimm-\); 

I 

( 

(at i; 

Ibr (i ■ 0; i < StO_REC0»D_LEN; ( 
■ati^Kd char c;~ 
hit nrud: 

nread - re8ttrr->ril. &c 1): 

If (nrcKt ^ m emw b EAOMN: 

tf (nrcMl 0) \ 

I* rrmo ii already set •/ 

f'>ceftaLms » I: 

«(■»(- 1): 
I clH tr rc A Q)t80) I 

r->p«t|0] = c; 

r->fipm - I; 

r->friincno - <c A FRAMENO^MASKl;. 
r->ttrnune • 0; . ~ ■* 

r«tara(Ol: 

I 

\ 

) 



* ruub amd rtmmt tm baegnl ntomher of reeandi 

* eorrtetly deaU wHh strrimg temp. 
•/ 

•Cilk lot 

iio_in«J(Horjr *f. tat nice*, mntttm* cter necs) SIO ircad 

I - ~ . 

/• ekeek arfs « f 
II Of) I 

cm» w EFAULT; 
rttar«(-h; 

I 

ir (nreei < 0) ( 
f->apan m Q; 
enmo a BNVAL; 

rctBn(-i): 

I 

If (unci mm 0) ntwa(Oh kaitdSe a ten fegmeei eleaidy * f 

If (!rccs) I 

r->«pin ■ a 

crnio - EPAULT: 
nmnd-\): 

I 
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seriox Mrio-c 

...sio irtad 

/• npan should never bt >=» StOJiECORD_Uft 

• if it is. thtn w* might ask for a rtftath^ 

• nttmb*r qf ften /hwn «rt«* J i*r Jwr nrvtr 

• ask for chars becauu wr ham a fitR rtecrd 

• in iA< partlat record b^f. 
' ihri€ *ui*m vrrifir this. 

• / 

osicftrnrco > 0); 

asi«rtff->npart < SIO_RECORD_LEN): 
{ 

lol mad; 

/• get iKw dam, leat^g spec* for aiready 
• rftid partial rreord 
•t 

nread ■ raid(f->W. 

((SrO_REC0RD_LEN • ntecj) - f->npartm 

t* thtck ftr emrx if so., fluth partiaJ records • / 
If (nmJ < 0> { 
f->npui - 0; 
rct«rs(-l): 

\ 

/* ch£ck to nwtf surt then is new dam rtady *t 
U <niead ««* 0> | 

I 

y* rtOMf ^/ tn /rom partiol records ' f 
t 

n^Mtr let I; 

for (i a ft i < r-XH»n; !♦♦) | 
) 

I 

nread *= r->ttp«t; 

/• now jov* txtra rreordt read *f 
I 

rciMtcr Imt I. o; 

rcgUter oottsncd cter *p: 

I 

r«glitcr lal Itmp: 

iimp = ((nitad / SIO_RECORD_LEN> * SrO.RECOIlD,LEN); 
p B ftrrcctllimpl): 
a s nmd • iinip; 

for « - fV. I < «: ( 

) 

f->npatt B n: 

J 

ratani(rtftad / SIO RECORD_LEKy, 

) 

) 

M 

iio^feadlilof_T •f. 
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scrlox scrio.c 



imCn)' 



0; 



if (in I 

ermo - EPAULT; /* Bad tkftftvjj •/ 
r«hira(-l); 

) 

/• nfmnt if necessary. • I 
If Cf->Tefra(ne) | 
lot r. 

If (r < 0) rttBfB(-ll: /• rnd vror •t 

ir {r > 0) ( /• didn't Jimd o frantt marker 

f->ltttamo =1; /• ynrttixj •/ 

ermo a DO; 

1 

I 

/• ihortm rt^mrl tifeetsary * f 
U in > SrO_MAXRBAD» a - StO^MAX^EAD; 



tmt nruOi 

■■dgDcd dnr (t»fISIO_MAXREAD • SIO.RECORD.LENI; 

nread - tlo freadTf, o. fbuf): 
If (tiread <"0) ( 

r-x«fnma • I; 

rrtiirti(-)): 

J 

t* check fiming * I 
\ 



for ( i » 0: I < Btutf; k+> | 

If {\ ((ftuflSJO RECORD LEN*il A 0*80) 

artMrfil0^ltEa5RD_L£N«i] & FRAMENO.HASIC) « (r->fr»mei»+4. A PRAMENO MASK)))) | 
r->refnne ■ I; 
ermo - EH>, 

I 

r 

ragbtoff Ul j; 

fiBr(i-l;i«S10 RECORD t^j4^> | 

if rntuncfio RECQfti>.teN*iHI> & oxk» < 

tm» ■ Eib: 
r-Merranw * I; 
r«tara(-l): 

I 

1 

I 

1 

I 

/* Ay now. tiv lAmtiU t9 oil Jhmtd ufif * I 
Buert(l F->fvAifDe): 

f4«flM BXTRACr VAUrtMr,iji) \ 

t(((rfauO[SIO iTeCORD LEN*(»1 A ((bSO » (a)1) « (n)) I \ 
(rtntOtSlO ItECORD lENIiWnH) 
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scrio.c 



rctUlcr irni I: 

for (i > 0; I < mead; { 

na[i],vM\l - EXTRACT VAUrtJufJ.lt; 
ftci[il.»ral2 m EXTRACT_VAUrt)ufj.2l: 
r«$lil.wl> «• EXTRACT_VAUrtiufjJ>; 

I 



rctsirnfnreod); 
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ldata*h 



ldata.h 



* 7Ti# interfact into th* daUt fitt utet$ ii in this fiJ*. 

* TTifi it carrtntty tht BDI standard data file formas. 

* Danin a. JewtU tigwtMMirrtmt FH ««« tH 02:4$: J I 1994 



ilbdtr LDATA H INCLUDED 
•AtflBe LDATaIHJNCLUDED 

fiaclade <le;;dsia.ti> 

ijfUa fl_(tMa IdB^T; 

typMlcf n_vaf kfv_T: 

men Ida T nclB Iniiftil i^ti. t\mt CCr. 

extern lit MB_flaw<lda_T *Um>, ckar ^filename); 
exttra tat lila~cbafmp(1ila_T •Uata); 

•xtcn Int Ida stortCldla T *ldlata. ckir Mujwmc. rh«r •tniu, 
flMt lo. Ami M. flmt *dta): 

ailcni lot lda_tet.npotntsrkla T *kteu. lal ^ttput 

citen tat ldi_gu_iliflili_T *Uat«, llwit *tt); 

titan tDt bta~B^~vaf(lilI T *kUuL ck*r Mu nunc, cbar *kinjii, 

OmC *1o. OmA •hi. Host Mu); 
•ttara IbI kta waDc v«niaTnet(lda_T *Mua, voM *id9e. 

Told {*«incl(lda_T "Idata. •rmic, ckar •vamaiM)); 

itadtf /• LDATA JiJNCLVDED *f 
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Idata.c 



Idnta.c 



* The intttfart into rkt data fit* us*d is in this flte. 

* This is currtnxty tht BDt standard data fiJt fi>rmat. 
m 

* Danin B. Uw^it QtwtmbdixomX Fri fhv M 02:43:3 i $904 




t 



flfndcr POStX SOURCE 
tdcRat 'POSIXlSOURCE 
tendif 

tlMClod* CtUfio.tl> 

fflBCtod* <emK>.ti> 

/• far mattocO end /ratf) • / 
tiactadt <sulltl>Ji> 

/• Jbr tint€ ST^ff * / 

ttDcloda <Ume.h> 

•incladc ciiriTig.h> 

Mndwle <leg(ljna.h> 

fiDCfnds -Uau.il-* 



t 

Idsti B lnii_data_^n)eO: 
tdait-xli o"dt: 

klait->out ■ ldatft->npolna * Ulu*->hpalRU > npts: 
(dni->la > 0; 

rctvni^klHi); 

I 

Sa'toatMehw ♦meaame) Idajood 

{ ~ 
Rl^ f : 

f - ri>f)en(ftleiiune.V); 

ir (f 0 I 

I 

rctnr«(Reid dau nic(0): 

I 

!di_»*ve(lda_T •IdaU. cfc«r •fllemoie) IdOJSave 



Ma T • 

Ida.inlUM npts. Roal ill) 



Ida init 



FILE n: 
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Idata.c Idata.c 

..Jdasave 

f « f6pcii(filenannc.'*Mr''); 
if (! 0 I 
ratarnl-l): 

» 

/• sei the ttmg fltU of tht fit* * / 
I 

char "what: 
char 'now; 
\mi ten: 
I 

time I t; 
ilmefAt); 

now « aimer fit); 

I 

Icn a Uilen(now); 

when {cbar *)ii«no<((ten-^l) * rianrfchar)): 
if <wtien) t 

iirepy(when. now); 

wt)en[leii-l| » V)': chop armtuu *t 
ftecHrM •)»dttt->wben): 
Idsta— >tNrteft • when; 

I 

I 

/• set th» Hit* fi$ld M ih* filmmf *l 

{ 

efaar tHle: 

ttile = (ctor •)iTw)kx((strkn(nienimeHl} • tfaaaCTckar)): 
tr Oitk) I 

rRs4(«vad •)IdBto->titk): 

KircpyOitle, fikosiM); 

l<lat»->tiile ■ tlUe; 

» 

\ 

Wn«c_dau_fiMhUta.O: 
rtC]ira(rckiie<n): 



Ida ftore(lda T *ldiu. cter *ila nime. ctar *tofiks, 
(iMt lo, Itoal turnaal *dti) 

I 

float 

Mata m (doal »)minccO<ht»->hfotttt» • ifaaeffOMt)): 
» (! rdaia> r«tm(-l): 

I 

(loal tan • (ttat(Q: 
flMl max - (ka(0]; 
I 

raglatar l«t I: 

far (i a 0; i < ldaCa->Bpainls; I+4 ) | 
ir (dtain < min) nil) - dUlM: 
ir (dtain > mu> tBU « dialil: 
rJatafl] - (Mil; 

» 

I 

AdJ_vii(ldua. du.Aime. uniu. la hi. mia mu. fdita): 
Apr 6 /2:0i i9P5 2 W^W-C 
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Idata.c Idata.c 



returB<0): 

1 

Sa cteAmipdda T *kl«a) IdojCUartUp 
I " 

/" HOtf tkat ihls catt vriU frre ttu abt^ aQoctd data vtcion * t 
Free datafldsn); 

I 

Sa_get npoinisadi T -UKa. lai -npa) Ida ^Ct npoinfS 
I " " 

If (!npts) retvrai'l): 

*np(s - ld«»->flpojnta; 

rcftorafO); 

I 

Sjn dKUu T itei. flomt Ml) ' lda_get_dt 

\ 

tr rikUla) r«tarm(-)]; 
If (tdO rvtuTBt-l): 

Ml ■ lJatt->dt 

rHarnfO); 

I 

lot 

Ida get vif<tda T *ld«a, char Mu oime. diar *«i)iu, 
DMt *la flut <hi. DMtt *dia) 



V - fnnd vBfOdaU, dla ntne); 
If (tv) nt«n(-n: 

If (dta) I 

rctisur Itt I: 

for 0 • O. i < Uat>-onpolnu; ( 
dtali] 3 v<*fdiia(i|: 

1 

I 

If (to) "lo - v->lew; 
W (W> » v->high; 
If (unitk> I 

ttmqijKuniU. w-xmili, UNITS LENGTKK 

uniMlUNITS LENGTH-11 • 

\ 

rcinraCO); 

} 

let 

Ida wuik vanumM(kii T void •misc. - . 

" * " veld (funcMldi T rotd Iniic, ctar *vOTi»inel) vara 

( 

ir (!ldaia) rttan (-1); 
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Idata.c 



Idata.c 



...void 



t 

rtsbttr lal i; 

for <i * (h f < klMa-xivftn; h^) ( 
(*ruiKKl<lH*t miic ld«i*->vn»met(i|); 

1 

I 

remnKO): 
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kneighbor.h 



kneighborJi 



* K-Seighbor 

* Simcmrai defiMtiions anrf ftmctianat dtclaratiofu for mptemauing ♦ 

* 04-0)-9S WCB cnattd. 



ticRM MAX.DATASET.nLELENGTH !28 

tTfcdcf ftrad I 

till num ^inu; 

lloal *poinl: 
I SAMPLE; 

tjrptder ttraet ( 

cbv rikn«ne|MAX_DATASET_nLELENOTH|; 

Inl num samples: 

SAMPLE" •umple: 
I DATASET. 

typcdcf atract | 

\m\ mun di; 
0ATAS6t •di; 
\ DATASEr_BANK: 

fiinaion dedantient * / 
lot k_beitn; 
IbI *k cotnpBffO; 
DATA5feT_BANK •fead_daUseia(); 
void free dMiist btnkO; 
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kneighbonc kneighborx 



/* 



* K-Ntighbor 

* Ftatctioni thai eomprUt tht k-ntansh^igMor aigorirlmi, * 

* iwarf datas0ts(i - rwad BDl data /U«j an^ enam a ^nhtmM ^ * 

datoM Hom n ts we user s uespohsibiltty to * 

Ftt££ TME KemtNED DATABANK BY CALUNC 

* FREE^DATAStr_aAtfK 

* JrttjiatmttjMMki) - fiu mtpury aUocaiid for your ikuabenk * 

* kjcatt^rcf} - compere en imfM gesOirt wilh the grthirrj in the * 

* tk* datobonk. Kttmm on ita«%*r array the * 

* datOMU that were chsett to the input festur*. * 

* NOTE: rr J5 THE USER'S RESPONSmtUTT TO FREE TTtE R£- 

* TURNED tNTEGER ARRAY. Juit tts* /rttfMi- ' 

* kjfestf) - given an integer array and a K lu/ur. rvtum Ott valm in * 

* ~ i/ie array tf^ wtts most fre^itentty intiieated in the Jirst * 

* K vabtti oj the army. 
• 

. 04-03-95 WCB ereatttL 



lladptfc -kMitMMT.h- 

ilsdads <udio.b> 
tluMt <tralloc.h> 
rtMtaii <strtngJi> 

vfild free dmet btnk<DATA$Er BANK •db) 

{ ~ ' 

t* Free an input daiaset hank 

Inpmt - db - a pointer to the tlaiawet bank to be freed. 

(Hap\tt - none 

• ••«••*«•••■•••«•«•»••**••«•«•• f 

iBi I, i: 

r«r (i 3 0; I < dl»->fiuni ds; I-m-) 
I 

freefdb-xto(t (.umple): 

1 

free(db->ds): 
1 

DATASET^BANK -ic«l_dMueu(lal usp. tkM 1fsv[|) 

/• crmi* a datoM bcitk fitsm a tist of BDt data fOet. Soma 
data verificaliem Is performed oi the end to unsure that 
the data is ail of tke same fimnet 
tttpiit - wTc - rutnber iff ebttti JUetmet listed In ofp>. 

tngv - orrof iiriufx. eocA iniicaiing the Jtttnem* 
of a BDl data file. 
Output - DATASET BANK • ~ a pointer to tk* creased daiebtwdL 
NOTE: THE USEIt'tS RESPONSIBLE FOR FREEING IHE RETURNED DATABANK, 
THE USER SHOULD USE frtoJatamJonHy 
**««••***•«*••*•••«•««*••*«•*•»»•««•••••««««•««''•««••*«»***•*••»••*« / 

iDt IJ^ 

FILE fp; 

DATASBT BANK Mb; 
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kneighbor.c knelghbor.c 



/* Perform bank and danuei tdkxatkms * / 

ir f(4Jb o (DATASer bank •)millDC(dl*onDATASBT BANK))) = (DATASET BANK •»> 

Kprttunsiden.'UiUbie to inocue DATASET.BANKSn^. cxitit);} 
ir ((db-xb 3 (DATASET •)milloc{ilwonDATASET)*wec|) — (DATASET •>(>} 

|fprintf(s(dm."Un*(e to inocate DATASETSNn"); cxitn);| 

dt>->Auin^ds - arge; 

Load toeh Dataitt */ 
r*r (i « 0; i < argc: K*) 
( 

ll_dDia *ldaia: 

/* Optn ihe datattt fii» * f 

If {Hrl«n<irgv(il> + I > MAX DATASET RULENGTH) 

{fprimf(it<*efr."MAX DATASET FILELRJCTM ftf "W excetded.VnHLENAME: «» LENCHT «d\fl". 
MAX_DATASET_ftLELENCfH. irivfil. lUknftrgvliD): eiiitl):! 
sircpy(d>->(ls(l|.8lcMme, ■rgv(rD; 

If «rp - tvpa^iUb-'^KiVMusMmz, V)) = (RLE •») 

{rpnntffHdefr.-'Uruble to opea Qk %t\n-. dtr-xls|i|.filefi«Dc); e»itn);| 

/• Rtad tht detasst * f 
ld»u - Read data fite(fp): 
tf (lldala) 

{(pT\nxKiVkxr,'UMMc to read BDI data nie %i\n'', (tt>->ds[11 nienune); 
«lt(i);l 

fetoaeifp); 

/* Tmnskat the dotostt * t 
db-xklil-Bum taraplcs ■ Idttft-xivin: 

tr ((dt>->dstl1.'9ample « (SAMPLE *)malloc(tlitoft SAMPLE) * ldau->nvin)) 
(SAMPLE *)0) 

(rtvlnifdidcfT-Unabb lo allocate «d SAMPLES for DATASET %a\a", 
ldat»->fiTan, d^xblilTitcnajne): c«ii(l)-J 
far (j « 0; J < db->d3(l |.nini_saniiples: 

db->d$ti).sample01.ntBn_poinis a ldata->npoints: 

If ((dt>->dini.iamitleU).potnt « (DmI •jmattocfststoKIlMtl * 1datt->npofma» a 

(rprhttflitdcTTr Unable lo allocate %A Hoats for DATASET %i umplc %(ftn*, 
ldaift->a|>oiBU. db->d4)intenamG. i*-!); exit(t):| 
for fk - Ch k < Maift->iipoij)u: k^) 

db->ds{i)tainpIeU]poim|lt| = Uaifrortlata|J1Ik); 

» 

Free dataCIdala): 

) 

/* Chcci dtOt^enk lampU sia coasiMncy */ 
for (i » I: i < dl>->anm <h: i+^> 

ir (db->d>(0|Mtn lampfas f- db->d4il-nua Mmplet) 

(rpriiuflaukff/dUtOR - AU dauieta tbuuU hive the sanw number of samplesAa Daiasei «s has «d uniplei bunnDtiue 
db->«la|0].nienJUM, (AM>di{0).iiiin)_fini{)tes. db->di[l| Hkname. 
db->ds4i| nuin_uinplBft>: eiiKIV, \ 

t* Chtck 4tatabank data potitt ctnuiaemy *f 
for <1 ■ 0; i c db->«um di; i-*-*^) 

tor a - 0; j < db-xbiiimim_iampfci: j^) 

ir (db->di[Ol.aaflaple{0).(uio_pol(iu l» dt>->dit)l uinp>e{J1-'niin poim} 

I fpcrtf(iideiT,-ERROIt - All duaaet umpka ahooW hive the same number of data potots An Oitsset »i Sampte %d 
db->dstO].afeiurae, 0, db->ds(0I.tuiiple|O].mim_pointi. 
ilb->dsll).nki«me. i. «>-xli|0|ja(npktninumj>olntj); eili(l);I 

rvtvriKdb): 
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I 

tal oom|nie(niwl villi, >■< n, DATASET BANK ^ tat ^length) 
( 

/* compart dn input array $o the w/mmu JtMipfcf m (kt dauaetjbimk 
atid ftnm OH irutgtr arfoy indieating in ordtr wttich thtat«ts 
Mvrtf cloMil Norn t/iat tack daloMt wUl appntr m th* rwtanm d 
tnUfer array an #4110/ nimb*r ef tmus to the umber ef samples 
provuied for that dataseL 

Inpta - fut ~ array Jtoats ttser would tike to compare to tbs 



n - ttRfth cf the ¥tU array, 
ih - pointer to the detaset >ank 
Ouput - int * - integer array of heu datarns, 

Itmgth " tengdi ef the integer array returned. 
WJTE: THE US£X IS RESPONSIBLE FOR FREEJNC Tim REWRhtEO IVTECER ARRAY. 
THE USEfi SHOULD USE J^efiai. 

f 

lot end; 
IbI ijjt.i: 
iBi •Ik; 

float *%fa. Nil; 

*leti|!tk ■ iKK>f)ttfn * dt^MlslOl.tuim samples: 
/• cfmA B •/ " 

If <n !>t (&-xls(0).SKnpk(01juiin Doinu) 

(fprinrfTsukn-, "Sample §%ti of dftlasd %Anhis %d data points but b bdng eo mpa rrd 10 %d daii po{Rts,\n''. 
1. dl>-xli(n-RkiMm«. a); aiUO;) 

/* aliocaie ike toned integer amy and fioat ttfrof */ 
It nta a (Ut ninanoc(aliMfCtel> * (*letk9li))) » 
(tat *)U) 

[rivi«nnden-.''Uu1>(B to allocate %d Int* in cmtpanftn'. 

Clentih)); atiKiX) 
If ((tfa - (ftool •>inalloc(aiMoff(llM«) • <«lcQgtb))) — 

[fprimfdideir/Un^ to allocaie %d Horn in cctttparcNn", 
(•IcBsUi]): exMI>:) 

/• feiibrm the comportsont *f 

tor {t B 0, cad ■(>:(< db-»«itini_ds: - - 

for fs - 0; I < db-xb|i}jttiin_un^^ 

for Q « 1. - (vBl[(q - <fli->ds|i|jaiitpli(i).p(»MO)> • 

(valtOl - dtHx)rfilMniple{tt.|»b«tOn; 
I c n: P/tl -MvalU) - (n»-Mbril.uraple[i|.potot|ji) « 

Cfallil - db-xh(l].»mplefiJ.poln!Uiy. 
fbr 0 » 0: J < end ^ sMJ) < fvat: 
tar (fc « end: It > }: kAAI • tft[k-l|. iafkl = la(k-tt, k— ); 
sfalil » fvat; laUl - 1; endti-; 

I 



I 



lal k_t]cu(tat *im. tat M 
( 

/" return the moss frequent entry m fft« ^nr k vciatM ef an 
mpm inieger array 

tnpia - u) - Inugtr array to be cheeked. 

k - ntmibar of ¥atms lo rfifc 
£>iirrHii " tni ~ Vattte most fttgumtty fomd tn the first k m£iui cf ia 
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lot ij: 

Int lofucore, lopvit, cuncorc; 

lopicore • 0: 
for (1 » 0; i < k: 
i 

If 0 — ») 



for 0 ^1* curseon a I; J < k; 



cuncoie *m tmj] » ia(i|)? 1:0. J-f+>: 



ir (cufiatre > lopscore) 

(lopuore = cuncorc: lopval a 

» 

) 

rctitnKiopvall; 



/^^r S 18:76 1995 
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Haviiig above indicated a prefeaed embodiment of the 
present invention, it will occur to those skilled in the ait that 
modiiications and altemadvcs can be practiced within the 
spirit of the invention. It is accordingly intended to define 
the scope of the invention only as indicated in the following 
claims. 

We claim: 

1. Apparatus for the control of on-saeen animated char- 
acters presented by a computer driven display to control the 
movement of said on-screen characters, comprising: 
a computer having a display coupled thereto; 
an egg shaped hand-held computer control device having 

at least one accelerometer therein; 
means for transmitting the ou^ut of said accelerometer to 

said counter; and, 
means fcr transmitting the output of said aoceleiometer to 

said conqyuter; and. 
means receiving said transmitted ou^ut for controlling 
the motion of said character In accordance with a 
characteristic of said accelerometer ou^t said means 
for controlling the motion of said character including 
means for providing a template corresponding to a 
predctamiDed characteristic of said ou^t means for 
matching said output to said template and means for 
controlling said on-screen character in a predetecmined 
fashion upon a nutcfa of said output to said template, 
said predetermined fashion including patterns of nK>ve- 
ment reflecting emotive content. 
Z The apparatus of daim 1, wherein said characteristic 
said ou^t includes characteristics relating to a predeter* 
mined pattern of behavior reflecting style. 

3. The apparatus of claim 1 and further including means 
for referencing said ou^ut to the local gravitational field at 
said device. 
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4. The apparatus of daim 3 wherein said referencing 
means includes hig^ pass filtering means for filtering out 
gravitational components such that said device functions in 
an orientation-indq>endent manner. 
s 5. The apparanis of daim 1 wherein said device is 
untethered to said computer. . 

6. The apparatus of daim 1 and further including an 
additional accelerometer oriented oithogonal to said accel- 
erometer. 

7. Hie apparatus of claim 1 wherein said output is directly 
coupled to said means for controlling die motion of said 
character and wherein said means for controUing the motion 
of said character includes means for specifying a generalized 
motion for said character, said direct coupled output con- 
trolling the style of die specified generalized motion of said 

^5 character. 

8. The apparatus of claim 1 and ftirther including a 
plurality of said templates, each of said templates corre- 
sponding to a different motion of both said device and said 
character. 

20 9. The appaiams of claim 8 wherein said means for 
controlling die motion of said character Includes means 
responsive to matdi with more than one tenqilate for con- 
trolling said on-screen character. 

10. The apparatus of daim 9 wherein said means for 
25 controlling the motion of said on-screen character includes 

means foe detecting successive matdies of said output with 
different ones of said templates and for controUing said 
motion responsive to the completion of successive matdies. 

11. The apparams of daim 1 wherein said means for 
30 controlling the motion of said character includes means for 

determining direction of the aocdcration of said device and 
means for moving said on-screen character in the direction 
of said determined direction of said acceleration. 

* * « * * 
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